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Abstract 


This study is designed to assess the mediating effect of the Service Quality in shaping the experience of 
users of e-Government applications. Users normally evaluate their satisfaction in using technological 
innovation such as e-Government from their direct and indirect involvement and the perceived value of 
the system in question. To study the mediation effect, a self-administered questionnaire based on a tested 
model is used to collect the experience of users of recently implemented e-Government applications in 
the public sector in Saudi Arabia. Data was gathered from 208 internal respondents and then analyzed 
using structural equation modeling (SEM). Different mediation models were tested and evaluated using 
common standard SEM parameters. The results showed that the value perceived from the System Qual- 
ity and Information Quality does impact the User Satisfaction, but Service Quality was found to play a 
stronger role in mediating the relationship between User Satisfaction and both the System Quality and 
Information Quality. The degree and direction of this mediation were analyzed and interpreted from the 
user and the technical support perspectives. The study compares these findings with those from earlier 
studies using similar models. 

Key words: e-government, mediation, structural equations modeling, information quality, system quality, 
service quality, user satisfaction. 


Introduction 


With high demands at increased functionality of citizens to utilize advanced technologies, 
many governments around the world are under pressure to provide advanced and customized 
services to its citizens through online applications. Thus many local governments have turned 
to information and communication technologies (ICT) to achieve this objective (Chen 2003). 
Although the achievement of such an objective is a challenge by itself, but ensuring that the 
offered services contribute to improved e-Government operational effectiveness and efficiency 
adds extra complexity (Gil-Garcia and Pardo, 2005; Yildiz, 2007). However, implementation of 
information systems in general is a challenging exercise experienced by all organizations taking 
such an initiative (Yildiz, 2007). The e-Government information systems are not exception as 
the implementation still facing many difficulties, which in many cases resulted to project fail- 
ures (Goldfinch 2007). Much research conducted to analyze underpinning causes of these fail- 
ures; some studies attribute the failures to lack of provision of required resources for successful 
implementation such as financial, infrastructure, and legalizations from the central government, 
(Al-Saber et al., 2007; Shackleton and Dawson, 2007; Mofleh et al.,2009). Others associated 
failure in e-Government implementation projects to not considering and integrating end users 
throughout the implementation process (Verdegem and Verleye 2009; Gauld et al., 2010). 
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Furthermore, as e-Governmental services become an essential part of modern interaction 
between local governments and citizens, the quality of offered services has taken an essential 
driving role in implementing e-Government systems (Naz 2009). Thus many public organiza- 
tions have taken this matter seriously and turned to innovation in information technology to 
offer variety of e-services at improved level of service quality (Chen 2003). The underpinning 
cause of this change in attention is the perceived anxiety on the quality of the offered services 
by the public sector (Halaris et al. 2007). To cater for this matter, much work has been published 
on the quality of offered services of e-Government applications (Santos, 2003, Lee & Lin 2005, 
Papadomichelaki et al. 2006, Hongxiu & Reima 2009). From this brief introduction, there is 
a need to evaluate how the quality of offered service in e-Government applications impacts 
User Satisfaction; which is a key topic of this study. Therefore, many studies highlighted the 
importance of considering both qualities of offered services as well the satisfaction of end users 
in managing the implementation of e-Government systems. Generally speaking, 1n developing 
countries and due to lack of local resources and experience, the local governments have turned 
to international consultancy services to assist them with the implementation of enterprise sys- 
tems such as e-Government applications. Although such approach is acceptable practice, but 
due to time constraints and focus on executive needs, the end user requirement might be over- 
looked. Technology in the Middle-East is widely accepted with internet penetration rate higher 
than the rest of the world (Al-Kouri 2013). This can be considered as an enabling success factor 
for successful implementing e-Government related applications with ability to reach and serve 
wider and remote communities (Bhatnagar, 2004). In the Kingdom of Saudi Arabia, various 
researches on e-Government were conducted focusing on different e-Government aspects (see 
for example El-Sofany et al 2012, Almalki, et al. 2013), but little work was published on the 
role of quality of service in effecting the User Satisfaction of e-Government systems. 

From above introduction, one aspect of this study is to analyze the impact of quality of 
offered services on the level of internal User Satisfaction in e-Government applications in some 
public sector organization in Saudi Arabia. Therefore, the main research question to be an- 
swered is: “To what extend the integration of Service Quality in the e-Government implementa- 
tion plans will improve the level of User Satisfaction?” However at this stage, the user within 
the context of this work refers to the ‘internal users’, 1.e. the management and support personnel 
within a public organization that are involved in facilitating the provision of e-Government 
services to the public citizens and services. 


Problem of Research 
This work is attempting to answer the following questions: 


Does the quality of the e-Government systems influence the User Satisfaction? 
Does the quality of the e-Government information influence the User Satisfaction? 
Do the System Quality and Information Quality mutually influence each other? 
Does the Service Quality offered by the e-Government support personnel mediate 
the relationship between System Quality and User Satisfaction? 

5. Does the Service Quality offered by the e-Government systems mediate the rela- 
tionship between Information Quality and User Satisfaction? 


oe 


Research Focus 


In conducting this research, the structural equation models and related approaches are 
utilized to study whether System Quality and/or Information Quality of the e-Government sys- 
tems affect the level of User Satisfaction in some organizations of the public sector in Saudi 
Arabia. The research related quantitative data were gathered through a self-administered ques- 
tionnaire directed to large service organizations in the public sector in Saudi Arabia which had 
recently implemented e-Government systems. 
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Methodology of Research 
General Background of Research 


Four key constructs are commonly used to measure the success or effectiveness of infor- 
mation systems (DeLone and McLean 1992, 2003, Nielsen 2005, Petter et.al, 2013, Jingyun et 
al. 2013). Based on this model and studies, the definitions of constructs used in this study are: 


System Quality: defined as a measure of technical efficacy, 1.e. the desired characteris- 
tics of the system. It is measured in terms of ease-of-use, functionality, reliability, flexibility, 
data quality, portability, integration, and importance. 

Information Quality: defined as the measurement of output from enterprise informa- 
tion systems. It is measured in terms of accuracy, timeliness, completeness, relevance, and 
consistency. 

Service Quality: defined as the level of service received by the users of enterprise i1n- 
formation systems and the manner in which the service is provided by the IS/IT department. It 
influences the degree of satisfaction with an enterprise information system and thus expected 
that training, support and online help are factors will impact the relationship between IS/IT sup- 
port services and the system users (Pitt et al., 1995). 

User Satisfaction: defined as the extent at which an information system (e-Government 
in this case) creates values to help internal users achieving expected level of satisfaction to 
improve their own job related performance measures. 


Sample of Research 


Five hundred (500) surveys were distributed to selected government organizations that 
had recently implemented e-Government systems. The respondents only returned 208 surveys, 
1.e. a 45.6% response rate. Each returned questionnaire was reviewed for completeness and, of 
the 208, eight were considered unusable due to large amounts of missing data, lack of involve- 
ment of the respondent in the use of e-Government system, or the impossibility of identifying 
the role of the respondent (manager, engineer or operator-user). Furthermore in order to 1m- 
prove the quality of the collected data, another 18 returned surveys were rejected due to missing 
data and due to ‘disengaged’ respondents, 1.e. respondents that tend to select one or two answers 
on the point-scale questions. 


Instrument and Procedures 


As stated by Orlikowski & Gash (1994) and Schein (1996), different workers in an orga- 
nization have different assumptions, expectations, knowledge and perceptions of technological 
innovation. Thus, the questionnaire used in this study was administered to managers, engineers 
(technologists), and administrative and operational staff to gather data related to various aspects 
of usage of enterprise information system. For this purpose, twenty five questions were selected 
from a pool of thirty two (32) questions compiled from three previous studies mentioned in 
the DeLone and McLean (2003). This questionnaire was previously used to study and evaluate 
various performance dimensions to assess operational effectiveness (Santa et al., 2009). 

A five-point Likert scale was used with | represents a ‘Strongly Disagree’ response and 
5 represents ‘Strongly Agree’ response. The workers were consulted before administering the 
surveys and they expressed willingness to take part in this study. Since this research is specifi- 
cally designed to assess the effect of system and information on the internal User Satisfaction, 
the workers were selected from different roles and positions. In this way the gathered data is 
directly related to the topic of this research and collected from professionals with relevant and 
adequate hands-on experience and knowledge. 
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In this study it is proposed that the quality of computer applications and quality of the 
produced information from e-Government systems have direct effect on the User Satisfaction. 
The users in the context of the present study are those involved in the actual usage of the sys- 
tems for operational purposes. More questions were used to assess whether the Service Quality 
plays a role in mediating the relationship between the System Quality & Information Quality 
on one hand and the User Satisfaction on the other. 


Data Analysis 


The ‘System Quality’ and ‘Information Quality’ are selected as exogenous variables and 
the ‘Service Quality’ and ‘User Satisfaction’ are the endogenous variables. Such models are 
often used for studying the operational effectiveness of information systems. The relationship 
between these constructs was the target of many studies; see for example DeLone & McLean 
1992, 2003; Nielsen 2005, Petter et.al, 2013, Jingjun et al. 2013. 

The gathered data were analysed using a multivariate statistical which combines path 
analysis with Confirmatory Factor Analysis (Hair et al. 2010). The SPSS application (version 
21.0), with AMOS add-on was used to construct the Structural Equation Model (SEM), is used 
to test the relationships depicted in the proposed casual model (see figure | below). These ap- 
plications are used to study how and to what extent the selected exogenous variables affect 
the “User Satisfaction’ in a direct relationship and indirectly through the mediating construct 
‘Service Quality’. Errors were considered by adding error parameters to each variable which 1s 
a standard approach to manage error (Hair et al. 2010). 

For the mediation aspect of this study, the Service Quality is considered as the media- 
tor between two independent variables: System Quality & Service Quality and the dependent 
variable: User Satisfaction. The approach adopted in this research started by first qualifying the 
raw data gathered through the questionnaire. This was done by removing partially filled cases 
(through identification of missing data), then removing cases of ‘disengaged users’ through 
calculating the standard deviation of each case and remove those cases with standard deviation 
below 0.6. Then Confirmatory Factor Analysis (CFA) was used to extract necessary factors 
required to identify the underlying data structure of gathered data set (Hair et al. 2010). In order 
to evaluate data reliability, the internal consistency measures (Cronbach’s a) were calculated 
for every extracted factor. 

The output of these steps is shown in table 1, together with other supporting description 
statistical measurements. The value of Kaiser-Meyer-Olkin (KMO) is 0.913 (with p<0.001) 
indicating the appropriateness of factor analysis with adequate sampling (Tabachnick & Fidell 
2007). 
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Table 1. Confirmatory Factor Analysis showing: Selected Factors, Data Relia- 
bility (Cronbach's a), Factor Items, Factor Loadings (8), Critical Ratio 
(CR), Standard Errors (SE), and Significance Level (P). 


Selected Factors  Cronbach’sa +s items «=39 Mean =i B—S——<“<i«é‘<CRC~<“‘<‘é«CSESO™”;*SC*RPCO™” 
SQ1 3.50 0.962 = a 
System Quality 0.879 SQ2 3.02 0.889 19.643 0.047 me 
SQ3 310 0.698 12.291 0.054 we 
lQ1 S01 0.787 - a 
12 «346 «©0840 «= 12.204 «S009 
Information Quality 0.876 13 «349 «= 0.736) 12.7657 
14 = 339'sti‘iTHTSC( (ti 
105 «=©6352—t—i‘iSsC“(<té«iS (tsi 
SRQ1 3.54 0.744 - - 
sRQ2 3.34 iS (ts«i (iG 
Service Quality 0.832 SRQ3 0 357—i(ité«iTC“‘<‘i‘a SC“‘i 
SR -3.38s—i(‘iéiSC“(<é‘ia CGC (tC 
SRO503.32Ststi—«iTBD_—s—“‘<iéidkzTSC tC 
US1 SOF 0.635 -- = 
User Satisfaction 0.792 Se 
US3 3.62 0.751 7.861 0.152 _ 


A total of four factors were extracted that explained a total variance of 58% and all fac- 
tor loadings are more than 0.6 which are accepted (Matsunag 2010). The constructs’ reliability 
factors (Cronbach’s a) exceeded the recommended standard 0.7 value (Hair et al 2006). These 
calculations indicate the suitability and reliability of the data used for conducting the Factor 
Analysis. 

The next step is using SEM technique to examine the structural relationships among 
the four selected constructs: System Quality, Information Quality, Service Quality, and User 
Satisfaction. The selection of SEM to investigate the factor analysis results facilitates simulta- 
neous test of both the structural model between the latent variables and the measurement model 
between the constructs (Kline 2005). For this purpose, two conceptual models are proposed, as 
shown in figures 1. In (a) the relationship between System Quality, Information Quality, and 
Ussr Satisfaction were quantified and analyzed. Then the same model was reassessed with ‘Ser- 
vice Quality’ added as a mediator as shown in figure 1b. The approach to evaluate mediation in 
this way is often suggested and report in the literature (see for example, Joseph et al 2010). 
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Figure 1. Conceptual path diagrams of models simulating the effect of “Sys- 
tem Quality”, “Information Quality” and “Service Quality”, on “User 
Satisfaction” for internal user of e-Government systems; (a) without 
mediating effect and (b) with “Service Quality” as the mediating vari- 
able. 


Results of Research 

Before proceeding with the interpretation of the mediating data for the proposed models 
in figure 1, the goodness-of-fitness of the two models was evaluated using Confirmatory Factor 
Analysis (Cooksey, 2007; Hair et al., 2010). The chi-square and goodness-of-fit statistics are 
listed in table 2. 


Table 2. Measurements of Model Goodness-of-Fit Parameters. 


Model re DFoéip vIDF RMSEA GFI CFI NFI IFl ‘TL 
yiarnia alal 92605 48 vs 1929 0.070 0.924 0.966 0.934 0,967 0.954 
Model B (with 194610 107 * 1819 0.066 0.894 0.953 0,904 0.954 0.941 
mediation) 


Note: Number of stars indicate the level of significance; *=0.05, **=0.01, and ***<0.001 


As can be seen from the table 2, for both models A and B, the ratio of chi-square to the 
degree of freedom (y2/DF) is 1.929 (with N=200, DF=48) and 1.819 (with N=200, DF=107) re- 
spectively. These values are acceptable and below the threshold value and thus indicate good fit 
(Bollen 1989; Kline 2005). Furthermore, additional goodness-of-fit parameters of GFI (good- 
ness-of-fit index), CFI (comparative fit index), NFI (Normal Fit Index), IFT (Incremental Fit 
Index), and TLI (Tucker-Lewis Index) are all over the minimum threshold of 0.9 (except for the 
GFI of model B) and less than 1.0 which again support that both prosed models do fit the re- 
search data. Finally, these findings are further supported by RESEA (root mean square error of 
approximation) value less than the recommended value of 0.08 (Browne & Cudeck, 1993, Hair 
et al., 1995, Hu & Bentler, 1999). All this data support each other and indicate that the hypoth- 
esized model fits the observed variance-covariance matrix well relative to null or independence 
model. 

The next actions are to examine the proposed two models shown in figure 1. First the direct 
effect of the relationships between System Quality, Information Quality, and User Satisfaction 
without mediation were examined (Holmbeck 1997). The results are shown in figure 2. 
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Figure 2. Results of testing the structural model shown in figure 1a. The rel- 
evant statists is shown in table 2. 


Figure 2 together with quantitative statistical data shown in table 2 indicate a good model 
fit with RMSEA less than 0.8 and CFI grated than 0.95 (Hu and Bentler 1999). Although weak, 
the data indicates that System Quality has positive correlation with the User Satisfaction with 
path weight of 0.15 and significant (P<0.001). Similarly, the path coefficients between ‘Infor- 
mation Quality’ and ‘User Satisfaction’ is 0.38 and between ‘Information Quality’ and ‘System 
Quality’ is 0.64. All these path coefficients are significant with P<0.001. Although to different 
extends, this data answer the first three queries stated earlier. Thus the research can be further 
advanced to study the mediation effect. 

The results stated above satisfy the first requirement to apply the mediation concept, 1.e. 
having a significant correlation to be mediated (Holmbeck 1997). First the partial mediation of 
Service Quality on (a) the effect of System Quality on User Satisfaction and (b) the effect of In- 
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formation Quality on User Satisfaction were studied. The full structural model for this analysis 
is shown in figure 3. 


Figure 3. Results of testing the structural model shown in figure 1b. The rel- 
evant statists is shown in table 2. 
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Figure 3, shows that System Quality and Information Quality are significantly associ- 
ated with the Service Quality (path coefficients are 0.23 and 0.51 respectively with p<0.001 in 
both). Furthermore, the Service Quality is significantly associated with the User Satisfaction 
with a path coefficient of 0.37 and P<0.02. However, the path coefficient between the System 
Quality and User Satisfaction is now reduced and become not significant. In addition, the path 
coefficient between Information Quality and User satisfaction was also reduced and become 
not significant. This data is summarized in Table 3 which also answers research questions 4 
and 5 stating that the quality of offered services associated with e-Government systems plays 
important role in determining the level of User Satisfaction. 


Table 3. Comparison of path coefficients with and without mediation. 


Without Mediation With Mediation 
Path Path Coefficient P Path Coefficient P 
System Quality > User Satisfaction 0.306 0.004 0.135 0.256 
Information Quality > User Satisfaction 0.529 iia 0.264 0.106 


Discussion 


This research starts by attempting to study the relationship between System Quality, 
Information Quality, and User Satisfaction. The study then moves further to examine the me- 
diation effect of the Service Quality offered by the e-Government systems on the these rela- 
tionships. The main expected outcome of this study is to evaluate whether Service Quality 
play important role in determining the level of User Satisfaction and the extent of this role. 
Despite extensive research activities on the User Satisfaction areas, but only few researchers 
studied these concepts within the e-Government in public sectors contexts. Generally speak- 
ing, in implementing e-Government systems, the vendors and consultancy companies often 
focus on the functional aspects only. This is particularly visible in developing countries where 
the implementation normally is performed by specialized consultants for different countries, 
culture, and backgrounds. Therefore, their mission is to deliver the scope of work by satisfy- 
ing and demonstrating expected technical and functional system capabilities to project owners 
and executive management who will sign the acceptance documents. Once project functional 
objectives are met and a signed-off, then the project is classified as success. However, from 
operational perspective, the appropriate assessment of system implementation would focus on 
how the systems achieve the expected operational effectiveness for the whole organization. In 
other words, to what degree the e-Government systems are able to establish processes, based on 
core capabilities within the organization that encourage them to exceed customer’s expectations 
(Porter, 1996; Evans and Lindsay, 2011) and use these accomplishments to achieve organiza- 
tional goals and benefits (DeLone and McLean 1992, 2003). One critical aspect of these expec- 
tations is the users’ satisfaction level, which was analyzed in this study from the perspective of 
relationship with System Quality and Information Quality. 

The mediation test indicates that Service Quality has stronger effect on User Satisfaction 
with high values of the correlation coefficients. This also can be seen through partially mediat- 
ing (almost total mediation) the relationship between System Quality and User Satisfaction. 
This in turns explains the moderately low direct effect (without mediation) of System Quality 
on the User Satisfaction. Furthermore, the Service Quality partially meditates between the In- 
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formation Quality and User Satisfaction. These results answered the questions on the affect of 
System Quality and Information Quality on User Satisfaction, which turned to be positive and 
consistent with earlier reported observations (DeLone and McLean 2003). However, this study 
showed that Service Quality plays rather stronger role in affecting the User Satisfaction, which 
made the effect of System Quality on User Satisfaction secondary. One potential explanation of 
these observations is that system users are evaluating the e-Government systems through their 
personal experience with the support services provided by the IT services personnel rather than 
the actual System Quality or Information Quality which are, for technical reasons, are shielded 
away from the end user. 

To extent this research further, the mediation roles of Service Quality can be further 
applied to the relationship between the Service Quality & Information Quality of e-Govern- 
ment systems and the End-Users Satisfaction (the public). Since the End-Users are completely 
‘shielded’ from the actual back-end of the e-Government systems, then it would be interesting 
to compare the degree and direction of mediation of Service Quality on User Satisfaction (in- 
ternal users) and End-User Satisfactions (external users). 


Conclusions 


With increased pressure on public organizations to provide effective and efficient servic- 
es to the citizens and businesses, many public organizations invested heavily in implementing 
e-Government systems. Naturally, a key objective in such initiatives is to serve the end-users, 
and thus user considerations and involvements must play an important success factor in project 
management. However, in post-implementation, many e-Government projects suffered from 
technical as well-as operational difficulties, which on one aspect, can be attributed to exclud- 
ing user involvements and in the implementation lifecycle. Therefore, 1t is important for the 
sponsoring organizations to understand the factors that impact the level of User Satisfaction 
and how improved implementation planning can help to improve satisfaction level. This study 
is attempting to analyze the role of support services offered by technical support personnel to 
improve the level of User Satisfactions with the final product. 

The study showed that the User Satisfaction of e-Government applications in day-to-day 
operations is partially mediated by the perceived Service Quality offered by the e-Government 
systems through the IT Service personnel. This mediation 1s taking place between User Satis- 
faction and both the System Quality and the Information Quality. Although it is assumed that 
high System Quality results in increased User Satisfaction, but this results seem to support that 
Service Quality play stronger role in impacting the level of attained User Satisfaction. Generally 
speaking, in implementing complex systems such as e-Government by an external consultancy 
firm, the focus is normally on satisfying project owners through demonstration of achieving 
system functional capabilities. Although System Quality and Information Quality play impor- 
tant roles in User Satisfaction, the current study indicated that the integration of Service Qual- 
ity during pre- and post-implementation phases of e-Government systems plays crucial roles 
in meeting user expectations. These results support that user-driven implementation has better 
chances to achieve targeted organizational performance objectives. The study also suggests that 
public organizations need to provide tailored IT Services specifically in the post-implementa- 
tion stage to attain acceptable level of User Satisfaction. Furthermore, the study also suggests 
the needs for careful integration of key stakeholders from the IT Support Services into the full 
life cycle of e-Government implementation and pre-planned and customized training programs 
can help increase the level of User Satisfaction. This in turns helps the organization take best 
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advantage of the investment and thus the targeted organizational objectives. 
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